- Title
- Motivated reinforcement learning for improved head actuation of humanoid robots
- Creator
- Fountain, Jake; Walker, Josiah; Budden, David; Mendes, Alexandre; Chalup, Stephan
- Relation
- Robot World Cup 2013: 17th Annual RoboCup International Symposium. RoboCup 2013: Robot World Cup XVII (Lecture Notes in Computer Science. Volume 8371) (Eindhoven, Netherlands 26-30 June, 2013) p. 268-279
- Publisher Link
- http://dx.doi.org/10.1007/978-3-662-44468-9_24
- Publisher
- Springer
- Resource Type
- conference paper
- Date
- 2014
- Description
- The ability of an autonomous agent to self-localise within its local environment is critically dependent on its ability to make accurate observations of static, salient features. This notion has driven considerable research into the development and improvement of feature extraction and object recognition algorithms, both within RoboCup and the robotics community at large. Instead, this paper focuses on a rarely-considered issue; determining an optimal policy for actuating a robot’s head, to ensure it observes regions of the environment that will maximise the positional nformation provided. The complexity of this task is magnified by a number of common computational issues; specifically high dimensionality state spaces and noisy environmental observations. This paper details the application of motivated reinforcement learning to partially overcome these issues, leading to an 11% improvement (relative to the null case of uniformly distributed actuation policies) in self-localisation for an agent trained online for less than 1 hour. The method is demonstrated as a viable method for improving self-localisation in robotics, without the need for further optimisation of object recognition or tuning of probabilistic filters.
- Subject
- motivated reinforcement learning; Fourier basis; head actuation; localisation; simulated curiosity
- Identifier
- http://hdl.handle.net/1959.13/1060059
- Identifier
- uon:16737
- Identifier
- ISBN:9783662444689
- Identifier
- ISSN:0302-9743
- Rights
- The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-662-44468-9_24
- Language
- eng
- Full Text
- Reviewed
- Hits: 1374
- Visitors: 2333
- Downloads: 330
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Author final version | 327 KB | Adobe Acrobat PDF | View Details Download |